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300 



306 




308 



N = 1 
Best_Focus - 0 
Best_Z = -999 
Focus Error = 0 



Initialization 




i 



304 

/ XJ/vlndow^Center 
/ Y_Window_Center 

X_Width 

Y_Height 

Number_of_Z_S lices 
\ Z_Step_Size 
\ Start Z value 



Move Z axis to Z_Position(N) = Start__Z value 



314 



N = N+1 



Acquire and 
Store !mage(N) 



310 



312 



Extract Image(N) 
focus Value F(N) 
Subroutine 



318 



Move Z axis to 
Z_Position(N) = Z_Position(N) + 
Z__Step_Size 




316 



320 



Best_Focus = F(N) 
Best Z = N 



No 



322 



326 




Best_Z = 
Number_of_Z_SIices/2 
Focus Error = 1 



Set Bestjmage = lmage(Best_Z) 
Set BestJmage_Z ~ Z_Position(Best_Z) 
Set a Pointer_to_BestJmage 



RETURN / ^ 



330 



FIG. 31 



312 




402 



Extract Image(N) 
focus value F(N) 
Initialization 



408 



404 



Pointer_to_StoredJ mage 



Convolve lmage(N) with Horz_Sobel Fliter to find 
Horizontal Edges creating image(N)_H 



-1 -2 -1 

0 0 0 

1 2 1 



410 



Convolve Image(N) with Vert_Sobel Fliter to find 
Vertical Edges creating lmage(N)_V 



414. 



-1 o 1 
-2 0 2 
-1 0 1 



SUM lmage(N)__H + lmage{N)_V to create 
image(N)_ Focus 
Truncate values to range of 0 to 255 



420 



Calculate Variance F(N) in 
lmage(N)_Focus over the 
desired window 



7 



RETURN 




424 



X_Window__Center 
Y_Window_Center 
X_Width 
Y_Height 



FIG. 32 



416 



418 



422 



440 



448 



450 




444 



Initialization 



^~ 442 

Pointer_to_BestJmage / 
Type_of_Classification \ 



Calculate Average_Gray_Background normalized for welll type by 
multiplying by Micro-well normalizer value 



Calculate Average__Gray_Classify_Window 



454 



\ Calculate Dlffjmage_1 

If ABS[PixeI(x,y) - Pixel(x+DifLSep,y+Diff_Sep)] > Flag_Thresh 
THEN 

DiffJmageJ Pixel(x,y) = Set1 
ELSE 

DiffJmageJ _Pixel(x,y) = 0 



456 



Calculate Diff Jmage_2 
If ABS[Pixel(x+Diff_Sep,y) - Pixel (x,y+Diff_Sep)] > 
Flag_Thresh 
THEN 

Diffjmage_2 Pixel(x,y)= Set1 
ELSE 

DiffJmage__2_Pixel(x,y) = 0 



458 



460 



Calculate Classify J mage 
lfDlffJmage_1„Pixel(x,y)= Set1 
OR 

Diffjmage_2 Pixel(x,y)= Set1 
THEN 

ClassifyJmage_Pixel(x,y) = Set2 
ELSE 

ClassifyJmage_Pixel(x,y) = 0 



462 



Calculate the number_PixeIs_Set2 
Calculate Total Pixels in Window 



iCore_Gray = Average_Gray_Classify_Window/Average_Gray_Background 
ScoreJ=lag = Number_Pixels_Set2/Total_PixelsJn_Window 



464 



CALL 

\Classify (Score_Gray, Score_Flag) subroutine 
FIG 34a step 468 
Type„of_Classification as parameter 



438 



452. 



RETURN ' 
to FIG 36 
step 852 



^466 



FIG. 33 



446 



X_BackGround_Center 
YJ3ackGrourtd_Center 
X_BackGround_Width 
Y_BackGroundJHeight 
Micro-well type Identifier 
Micro-well normer value 



X_Classify_Center 

Y_Classify_Center 

X_Classify_Width 

Y_Classify_Height 

Diff_Sep 

Set1 

Set2 

Flag_Thresh 



464 



468 



Start 
Classify 
(Score_Gray, 
Score_Flag) 
^subrotine^ 



470 



Initialization 
CLASS = 5 



483 



Calculate CLEAR 
If Score_Flag < C!ear_Flag_LT 
AND 

Score J3ray > Clear_Gray_GT 
THEN 
CLASS = 0 



484 



Calculate Light Precipitation 
If Score_Flag < Lgt__Precip_Flag_LT 
AND 

Score_Flag > Lgt_Precip_Flag_GT 
AND 

Score__Gray > Lgt_Precip_Gray_GT 
THEN 
CLASS = 1 



Calculate Heavy Precipitation 
If Score_Flag < Heavy_Precip_Flag_LT 
AND 

Score_Flag > Heavy_Precip_Flag_GT 
AND 

Score_Gray < Heavy__Precip_GrayJ_T 
THEN 
CLASS = 2 



488 



Calculate Ugly Precipitation 
If Score_Flag < Ugly_Precip_Flag_LT 
AND 

Score__Flag > UgIy_Precip_Flag_GT 
AND 

ScorejGray < Ugiy_Precip_Gray_LT 
THEN 
CLASS = 3 



492 




480 




482 



Clear_Flag_LT 
Clear_GrayJ3T 



478 



Lgt_Precip_FlagJ_T 
Lgt_Precip_Flag_GT 
Lgt_Precip_Gray_GT 1 



486 



Heavy_Precip_FIag_LT 
Heavy_Precip_FlagJ3T 
Heavy_Precip__Gray_LT 



490 



Ugly_Precip_Flag_LT 
Ugly_Precip_Flag_GT 
UgIy_Precip_Gray_LT 



FIG. 34a 
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701 




Calculate Micro_ Crystals 
If Score_Flag > Micro _Cry__Flag_GT 
AND " 

Score_Gray < Micro Cry_GrayJ_T 
THEN" 
CLASS = 8 



703 




Micro_Cry_Flag_GT 
Micro__Cry_Gray_LT 



704 



Calculate Crystal 
If Score_Flag < Crystal_Flag_LT 
AND 

Score_Flag > Crystal_Flag_GT 
AND 

Score_Gray > CrystaLGray_GT 
THEN 
CLASS = 9 



705 



Crystal_FlagJ_T 
Crystai_Flag_GT 
Crystal__Gray_GT 1 



706 



Calculate GRAINY_Precipation 
If CLASS ==8 
AND 

Score_Flag > Grainy_Flag_GT 
AND 

Score_Gray > Grainy_Gray_GT 
THEN 
CLASS = 7 



707 



Grainy_Flag__GT 
Grainy_Gray_GT 
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A 



708 



'GOTO FlG\ 
34c 
step 726 / 



FIG. 34b 
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725 



727 




726 



\ Calculate a first set of Additional Image 

Features in Classifyjmage 
CALL Subroutine MVT_Jools_Blob_Analysis 
with pointer to Window in Classifyjmage 
Get 
num_found 
and for each found GET 
area(m), height(m), width(m), perimeter(m) 
location_X(m), location_Y(m) 



728 




X_Classify_Center 
Y_CIassify_Center 
X„CIassify_Width 
Y_Ciassiiy_Height 
Pointer_To_Classify J mag 

mvt_blob_analysis_params 



729 



Yes- 



m = 1 
num_spherolite = 0 
spherolite(m) = 0 



730 



Calculate B!ob_Ratios 
Circie_Like_HW(m) = height(m)/width(m) 
Circle_Like_AHW(rn) = area(m)/(height(m)*width(m)) 



732 



No 



Calculate Spherolite 
If CLASS = 8 OR 9 
AND 

Circle_Like_HW(m) < Circle JJkeJHWJJpper 
AND 

CircIeJJkeJHW(m) >Circle_LikeJHW_Lower 
AND 

Circle_Like_AHW(m) < Circle_Like_AHW_Upper 
AND 

CirdeJ_ike_AHW(m) >Circle_Like_AHW_Lower 
THEN 

num_spherolite = num_spherolite +1 
m = m+1 
spherolite(m) = 1 



734 



;ircle_JJke_HWJower 
Circle JikeJHW_Uppe 
r 

Circle_Like_AHWJow 
er 

Circle_Like_AHWJJp 
oer 



-No- 



736 



m = num found 



739 



If num_Spherolite > 0 then CLASS = 6 



-Yes- 



/GOTCf 
W FIG 34d 
Wp 742 



738 

FIG. 34c 



c 



- 740 



744 



742 




Calculate a second set Additional Image 
Features in Bestjmage 
Using the results from the previous 
MVT_Tools_B!ob_Analysis on the 
Classifyjmage 
m = 0 
num_phase_sep = 0 



746 



'.Average_GrayJ3ackground 

Pointer_To_Best J mage 

num„found 

area(m), height(m), 

width(m), perimeter(m) 

location_X(m) 

location_Y(m) 

num_spherolite 

spherolite(m) 





758 



Usihg Iocation_X(m), location_Y(m), 1/2(height(m)), 1/2(width(m) 
calculate the average gray value within this reduce window for each 
spherolite previously found and set phase_sep_Gray(m) = to the 

found value 
then Normalize it by calculating 
phase_sep_Gray(m) =phase_sep_Gray(m) / 
.Average_Gray_Background 



752 



: phase_sep_Gray > phase_sep_Gray_GT 
THEN 
CLASS = 4 



-754 



phase_sepj3ray__GT 



FIG. 34d 
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760 




Analyze previously measured features from FIG 34c to 
further separate CLASS 9 into sub-classes 9.0 through 
9.9 
set m = 0 

First test if CLASS = 9, if not then goto step 778 
if true then 
CLASS = 9.0 
if nurn_found =1 then goto step 768 
if not goto769 



YES- 



768 



771 



m= 1 

HWJRatio = Height(m) / Width 
(m) 

If HW_Ratio > needle_HW_GT 
or 

HW_Ratio < needle_HW_LT 
then CLASS = 9.2 



2 



770 



If HW__Ratio > plate_HW_GT 
or 

HW_Ratio < plate JHWJLT 
then CLASS = 9.4 
THEN goto 773 ELSE goto step 778 



plate_HVV_GT 
plate_HWJ_T 



YES- 



Using locationJK(m), location_Y(m), 1/2(height(m)), 1/2(width(m) ) 
calculate the average gray value within this reduce window for the Blob 
previously found and set Chunk_Gray(m) = to the found value 

then Normalize it by calculating 
Chunk_Gray(m) =Chunk_Gray(m) /Average_Gray_Backg round 



NO 



774 



776 



If Chunk_Gray < ChunkJ3ray_LT 
THEN 
CLASS = 9.6 



766 



V.Average_Gray_Backgr 
ound 

Pointer__To_Best_) mage 
num_found 
area(m), height(m), 
width(m), perimeter(m) 
location_X(m) 
location__Y(m) 
num_spherolite 
v spherolite(m) 



needle_HW„GT 
needle HW LT 





773 



775 



Chunk_Gray_LT 



If area(m) > Chunk_50_GT 
THEN 
CLASS = 9.8 



777 



Chunk 50 GT 




779 




FIG. 35a 



781 



782 



786 



NO 




For m = 0 to num_found 
Calculate for each blob 



788 



\ 



Average_Gray_Background 

Pointer_To_BestJmage 

numjbund 

area(m), height(m) f width(m), 

perimeter(m) 

Iocation_X(m) 

location_Y(m) 

num_spherolite 

spherolite(m) 




784 



m m + 1 
HWJRatio = Height(m) / Width 
(m) 

If HW_Ratio > needle_HW_GT 
or 

HW_Ratio < needle_HW_LT 
then CLASS = 9.1 



794 



needle_HW_GT 
needle HW LT 



790 



If HW_Ratio > plate_HW_GT 
or 

HWJRatio < plate_HW_LT 
then CLASS = 9.3 
THEN goto 798 ELSE goto step 812 



796 



plate_HW_GT 
plate_HW_LT 



NO 



YES 



798 



Using location_X(m) ( location JV (m), 1/2(height(m)), 1/2(width(m) ) 
calculate the average gray value vi/ithin this reduce window for the Blob 
previously found and set Chunk_Gray(m) = to the found value 

then Normalize it by calculating 
Chunk_Gray(m) =Chunk_Gray(m) /Average_Gray_Background 



802 



806 



If Chunk_Gray < Chunk_Gray_LT 
THEN 
CLASS = 9.5 



i 



804 



Chunk_GrayJ_T 



If area(m) > Chunk_50J3T 
THEN 
CLASS = 9.7 




808 



Chunk 50 GT 



FIG. 35b 



Return to FIG 33 
step 466 



840 




/ Initialization Parameters 
A Inspection Lists 
1 Type_of_Classification 




846 



Move to micro-well within 
selected micro-well plate 




-NO 



849 



YES> 



acquire image and locate 




droplet 






-856 i 



Move to droplet within 
micro-well in micro-well 
plate 



acquire droplet high- 
resolution image 




850 



CALL Specimen Auto Score & 1 
Classify Subroutine 
FIG 33 step 440 
Type_of_Classification as 
parameter 




FIG. 36 
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